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On the replica symmetric solution of the ^-sat model. 

Dmitry Panchenko* 



(^ I Abstract 

^ I In this paper we translate Talagrand's solution of the K-sat model at high temperature into 

p ■ the language of asymptotic Gibbs measures. Using exact cavity equations in the infinite volume 

<^ . limit allows us to remove many technicalities of the inductions on the system size, which 



clarifies the main ideas of the proof. This approach also yields a larger region of parameters 
p^i ' where the system is in a pure state and, in particular, for small connectivity parameter we prove 

the replica symmetric formula for the free energy at any temperature. 

Oh 
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1 Introduction 

p^ . The replica symmetric solution of the random K-sat model at high temperature was first proved 

5/^ I by Talagrand in [8], and later the argument was improved in []9l and, again, in [fTOl . The main 

technical tool of the proof is the so called cavity method, but there are several other interesting and 
non-trivial ideas that play an important role. In this paper, we will translate these ideas into the 



O ■ language of asymptotic Gibbs measures developed by the author in [7]. The main advantage of this 

^^ ' approach is that the cavity equations become exact in the infinite volume limit, which allows us to 

bypass all subtle inductions on the size of the system and to clarify the essential ideas. Using the 

exact cavity equations, we will also be able to prove that the system is in a pure state for a larger 

region of parameters. 
c^ ■ Consider an integer p >2 and real numbers a > 0, called the connectivity parameter, and 

j8 > 0, called the inverse temperature parameter. Consider a random function 

e(ai,...,a^) = -/3 n ^-^ (1) 

l<i<p ^ 

on { — 1, 1}^, where {Ji)i<i<p are independent random signs, P(7, = ±1) = 1/2. Let {Ok)k>i be 
a sequence of independent copies of the function 0, defined in terms of independent copies of 
(Ji) i<i<p- Using this sequence, we define a Hamiltonian Hf^{o) on Eyy = { — 1, 1}^ by 

-Hj,{a)= £ 0,(a,,„...,a,-^J, (2) 

k<7t{aN) 
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where n{aN) is a Poisson random variable with the mean aN and the indices {ij,k)i.k>i ^^ inde- 
pendent uniform on {1, . . . , A^}. This is the Hamikonian of the random ^-sat model with K = p, 
and our goal will be to compute the limit of the free energy 

iw = ^Elog Y, exp(-//^(a)) (3) 

as A^ — i- oo in some region of parameters (a, /3 ) . It will be convenient to extend the definition of the 
function 6 from { — 1, 1}^ to [— 1, 1]^ as follows. Since the product over 1 <i<pm^ takes only 
two values and 1 , we can write 



exp0(ai,...,c7p) = l + (e-^-l) H 



1+7,(7/ 



2 

l<i<p ^ 

At some point, we will be averaging exp d over the coordinates Ci , . . . , cr^ independently of each 
other, so the resulting average will be of the same form with a, taking values in [—1,1]. It will be 
our choice to represent this average again as exp 6 with 6 now defined by 

0(ai,...,cT,)=log(l + (.-/^-l) n ^-^)- (4) 

l<i<p 

Of course, on the set { — 1 , 1 j^ this definition coincides with ([U). Note that this function takes values 
in the interval [— /3 , 0] . 

Let us denote by Pr[— 1, 1] the set of probability measures on [—1,1]. Given ^ G Pr[— 1, 1], let 
izi)i>i and {zij)ij>i be i.i.d. random variables with the distribution ^ and let 

^(C)=log2 + ElogAvexp £ 0yt(zi,fc,- • • ,Zp-i,fe,e) 

k<7t{pa) 

-(;?-l)aE0(zi,...,Zp), (5) 

where K{ap) is a Poisson random variable with the mean ap independent of everything else and 
Av denotes the average over e G { — 1,1}. The functional <^(C) is called the replica symmetric 
formula in this model. Our first result will hold in the region of parameters 

min(4/3,l)(p-l)pa< 1. (6) 

In this case, we will show that asymptotically the system is always in a pure state in the sense that 
will be explained in Section [3] and the following holds. 



Theorem 17/'® holds then 



limF^= inf ^(O. (7) 



Notice that when the connectivity parameter a is small, {p—\)pa<\, the formula (|7]) holds for 
all temperatures, which is a new feature of our approach. One can say more under the additional 
assumption that 

]^{e^-l){p-l)pa<\. (8) 



In particular, in this case one can show that the asymptotic Gibbs measure, which will be defined 
in the next section, is unique and, as a result, the infimum in (|7]) can be replaced by ^{Q, where 
^ can be characterized as a fixed point of a certain map arising from the cavity computations. For 
r > 1, let us consider a (random) function Tr'. [—1, 1]^p^^>'' — )■ [—1,1] defined by 

// \ Av£expA(£) 

\ J, j-i . - / AvexpA(e) 

where 

A(e) = £ Okioi^k, ■■■, Op-i^k, £)■ (10) 

k<r 

We set To = and define a map 

r:Pr[-l,l]^Pr[-l,l] (11) 

in terms of the functions (Tr) as follows. Given ^ G Pr[— 1, 1], if we again let {zj^k)j<p-i,k>i be 
i.i.d. random variables with the distribution ^ then T{Q is defined by 

T{Q = ^{TK{ap){iZj,k)j<p-l,k<K(ap)} 

[ap) 

r>0 



£ (M:,-«P^(^r,((z,-,),<,_i,,<.)), (12) 



where ^(X) denotes the distribution of X. In the second line, we simply wrote the distribution 
as a mixture over possible values of n{ap), since this Poisson random variable is independent of 
everything else. The following is essentially the main result in Chapter 6 in [10|. 

Theorem 2 If ^ holds then the map T has a unique fixed point, T{C,) = C,. If both © and ([§]) 
hold then Xvcsxn^^Fm = ^{Q- 

As we already mentioned, the main ideas of the proof we give here will be the same as in [fTOl but, 
hopefully, more transparent. Of course, there is a trade-off in the sense that, instead of working 
with approximate cavity computations for systems of finite size and using the induction on A^, one 
needs to understand how these cavity computations can be written rigorously in the infinite volume 
limit, which was the main point of [7J. However, we believe that passing through this asymptotic 
description makes the whole proofless technical and more conceptual. Moreover, the results in [7] 
hold for all parameters, and here we simply specialize the general theory to the high temperature 
region using methods developed in [|8ll9llT0l. 

In the next section, we will review the definition of asymptotic Gibbs measures and recall the 
main results from [7|, namely, the exact cavity equations and the formula for the free energy in 
terms of asymptotic Gibbs measures. In Section |3l we will prove that, under (|6]), all asymptotic 
Gibbs measures concentrate on one (random) function (so the system is in a pure state) and in 
Section |4] we will deduce Theorem [H from this fact. Finally, in Section [51 we will prove Theorem |2] 
by showing that, under (|6l) and ([8]), the asymptotic Gibbs measure is unique. Of course, as in [[TOl . 
the same proof works for diluted p-spin models as well but, for simplicity of notations, we will 
work only with the Hamiltonian ^ of the p-sat model. 



2 Asymptotic Gibbs measures 

In this section we will review the main results in [7] starting with the definition of asymptotic Gibbs 
measures. The Gibbs measure Gn corresponding to the Hamiltonian dD is a (random) probability 
measure on { — 1, 1}^ defined by 

G^(a) = ^exp(-//yv(cT)) (13) 

where the normalizing factor Z/y is called the partition function. Let (a )^>i be an i.i.d. sequence 
of replicas drawn from the Gibbs measure Gyy and let /iyy denote the joint distribution of the array 
of all spins on all replicas, (o'/)i<ka'/>i, under the average product Gibbs measure EG^°°. In 
other words, for any choice of signs af G { — 1, 1} and any n > 1, 

^f^([af = a\ : I <i <N,1 < i <n}) = EG®"('{a/ = af : 1 <i <N,1 < i <n}Y (14) 

Let us extend Hn to a distribution on { — 1, ij^x^ simply by setting a- = for i > N + 1. Let 
^ be the sets of all possible limits of (/J.jv) over subsequences with respect to weak convergence 
of measures on the compact product space { — 1, 1}^^^. We will call these limits the asymptotic 
Gibbs measures. One crucial property that these measures inherit from /iyy is the invariance under 
the permutation of both spin and replica indices i and (.. Invariance under the permutation of the 
replica indices is obvious, and invariance under the permutation of the spin index holds because 
the distribution of the Hamiltonian Q is invariant under any such permutation. In other words, 
there is symmetry between coordinates in distribution, which is called symmetry between sites. 

Because of these symmetries, all asymptotic Gibbs measures have some special structure. 
By the Aldous-Hoover representation [1 , 4], for any /i G ^, there exists a measurable function 
o : [0, 1]^ — )■ { — 1, 1} such that jU is the distribution of the array 

^f = a(w,M£,v,,x,-,f), (15) 

where random variables w, (m/), (v,), {xu) are i.i.d. uniform on [0, 1]. The function o is defined 
uniquely for a given /i G ^ , up to measure-preserving transformations (Theorem 2.1 in [|5J), so 
we can identify the distribution /i of array (^f) with a. Since, in our case, a take values in { — 1, 1}, 
the distribution /i is completely encoded by the function 

a(w, M,v) = ExC7(w, M,v,x) (16) 



where E^ is the expectation in x only. The last coordinate xij in (1151) is independent for all pairs 
(/,£), and we can think of it as flipping a coin with the expected value d(w, w^, v,). In fact, given 
the function (fT6l) . we can always redefine o by 

o{w,ut,Vi,Xi/) = 2l[xi^i< -(l+d(w,M^,v/))j -1. 

One can think of the function d in a more geometric way as a Gibbs measure on the space of 
functions, as follows. It is well known that asymptotically the joint distribution /i G ^ of all spins 
contains the same information as the joint distribution of all so called multi-overlaps 



<.-../, = ^ E '^''■■■'^t (17) 



\<i<N 



for all « > 1 and all £i, . . . ,£„ > 1. This is easy to see by expressing the joint moments of one 
array in terms of the joint moment of the other. In particular, one can check that the asymptotic 
distribution of the array (fTTT ) over a subsequence of jUa? converging to jU G ^ coincides with the 
distribution of the array 

^^i,...,4 =Eva(w,M^j,v)---a(w,M4,v) (18) 

for n > 1 and £i, . . . ,£„ > 1, where Ey denotes the expectation in the last coordinate v only. The 
average of replicas over spins in (fTTT ) has been replaced by the average of functions over the last 
coordinate, and we can think of the sequence (^(w,^^, ■))£>! as an i.i.d. sequence of replicas 
sampled from the (random) probability measure 

Gvv = ^Mo (m — ). d-(w, M, •)) (19) 

on the space L^ ( [0, 1 ] , dv) n { 1 1 a 1 1 oo < 1 } with the topology of L^ ( [0, 1 ] , dv) . Here, both du and dv 
denote the Lebesgue measure on [0, 1]. Thus, thanks to the Aldous-Hoover representation, to every 
asymptotic Gibbs measure \l E M we can associate a function a on [0, 1]-^ or a random measure 
G„, of the above space of functions. One can find a related interpretation in terms of exchangeable 
random measures in [2J. 

The main idea introduced in [|71 was a special regularizing perturbation of the Hamiltonian 
Hn{o) that allows to pass some standard cavity computations for the Gibbs measure G^f to the 
limit and state them in terms of the asymptotic Gibbs measures /i G ^. We will refer to [7J for 
details and only mention that the perturbation mimics adding to the system a random number (of 
order log A'') of cavity coordinates from the beginning. Because of this perturbation, treating a finite 
number of coordinates as cavity coordinates is "not felt" by the Gibbs measure, which results in a 
number of useful properties in the limit. The perturbation is small enough and does not affect the 
limit of the free energy F^. In the rest of this section, we will describe the cavity equations in terms 
of the functions o in (fT5l) and state some of their consequences. 

Let us introduce some notation. We will often need to pick various sets of different spin 
coordinates in the array (sf) in (flSl) . and it is quite inconvenient to enumerate them using one 
index / > 1. Instead, we will use multi-indices (/i, . . . , in) for n > 1 and ii,. ..J„ > 1 and consider 

Sii,...,in = cy(w,M,v/i,...,,„,x,-i,.. .,,„), (20) 

where (v/j^...^,„), (jc,i,...j„) are i.i.d. uniform on [0, 1]. In addition to (|20l) . we will need 

Sii,...,i„ = a(w,M,v,i,...,,„,je,;,.. .,,„), (21) 

for some independent copies v and x of the sequences v and x. Let (O,,, ...,/„) and (0/,,...j„) be i.i.d. 
copies of the random function 6. 

Take arbitrary integer n,m,q,r> 1 such that n<m. The index q will represent the number of 
replicas selected, m will be the total number of spin coordinates and n will be the number of cavity 
coordinates. The parameter r > 1 will index certain terms in the cavity equations that are allowed 
because of the stability properties of the Hamiltonian (|2]); these terms played an important role in 
llTl and will appear in the formulation of the mains results from [7], but will not be used throughout 
this paper after that. For each replica index i < q we consider an arbitrary subset of coordinates 
Q ^ { 1 5 • • • 7 "^} and split them into cavity and non-cavity coordinates 

q1 =Qn{l,...,n}, C| = Qn{n+l,...,m}. (22) 



The following quantities represent the cavity fields for / > 1, 

M£)= E 0fc,/(*i,/,/t,---,*p-i,;>,e), (23) 

k<7ii{ap) 

where e G {—1, 1} and (;r,(ap)),>i are i.i.d. Poisson random variables with the mean ap. Let E' 
denote the expectation in u and the sequences x and x, and Av denote the average over (e,)/>i in 
{ — 1,1}^ with respect to the uniform distribution. Define 

Ue = E' (av ( n £'■ e^P LM^d) Yl ^i^^P £ Ok{s\k, ..., Sp,k] 

ieCJ. '■<" ieCJ k<r 

V=¥l (av (exp £ A,(e,-)) exp £ 4(^^i,^, • • ■ , Sp.k)) ■ (24) 

i<n k<r 

The following result proved in Theorem 1 in [7] expresses some standard cavity computations in 
terms of the asymptotic Gibbs measures. 



Theorem 3 For any n G ^ and the corresponding function o in dlJl) . 

The left hand side can be written using replicas as EYlfKqYlieCe^h ^^ it represent an arbitrary 
joint moment of spins in the array (flST ). The right hand side expresses what happens to this joint 
moment when we treat the first n spins as cavity coordinates. As in [|7l, we will denote by ^inv the 
set of distributions of exchangeable arrays generated by functions a : [0, 1]^ —t- { — 1, 1} as in (fT5l) 
that satisfy the cavity equations (l25l) for all possible choices of parameters. Theorem |3] shows that 
^ C ^i„y, which was the key to proving the formula for the free energy in terms of asymptotic 
Gibbs measures. Let us consider the functional 

^(ju)=log2 + ElogrAvexp £ ^^(^i,^,- • • ,^p-i,yt,e) 

k<7t{pa) 

- {p - l)aE\ogE' expe{si, ... ,Sp) . (26) 

The next result was proved in Theorem 2 in [|71. 
Theorem 4 The following holds, 

\imFN= M ^{^)= inf ^{^). (27) 

Remark. This result was stated in [7] for even p >2 only, where this condition was used in the 
proof of the Franz-Leone upper bound [3 1 . However, in the case of the p-sat model the proof works 
for all p without any changes at all, as was observed in Theorem 6.5.1 in IfTOl . The condition that 
p is even is needed in the corresponding result for the diluted p-spin model, and that is why it 
appears in [l6l|7l, where both models were treated at the same time. 



For some applications, it will be convenient to rewrite (|25l ) in a slightly different form. From 
now on, we will not be using the terms 6^ in (|24|) . so we will now set r = 0. Let us consider some 
function f {01,02) on { — 1, 1}'"^^ of the arguments 

ai=(af,...,ai)i<,<,G{-l,irx^, 

CT2= (ai+i,...,cT,l)i<,<,G{-l,l}('"-")^^. (28) 

For example, if we consider the function 

/(^i,cT2)=nn^/=n(n^/n^/) (29) 

then the left hand side of (l25l) can be written as ¥.f{si,S2), where si and S2 are the corresponding 
subarrays of [s^) in (fTSi) . To rewrite the right hand side, similarly to (lIOT i. let us consider 

4,...,^« = ^(^'"^^'1,. ..,!«' 4,.. .,/„), (30) 

where, as always, all the variables are i.i.d. uniform on [0, 1] for different indices and define, for 

<f(£) = nexp£A,,(e/), (31) 

i<q i<n 

where 

A,-,(e/)= £ eu{A,p---^i-up£^)- (32) 

/c<;r,(o!p) 
Then, with this notation, the equation (|25l) can be rewritten as 



E/(.i,.2)-E ^,^^^^^^ . (33) 

Simply, we expressed a product of expectations E' over replicas £ < ^ by an expectation of the 
product, using replicas of the random variables u and x that are being averaged. Since any function 
/on{ — l,l}™^^isa linear combination of monomials of the type (|29|) . (1331 ) holds for any such /. 
From here, it is not difficult to conclude that for any functions fi,. . .^f^ on { — 1,1}'"^^ and any 
continuous function F : M^ — ;■ R, 

EF(E/i(.M2),-.,EA(.M2))=EF( ^,^^^^^^ ,..., ^,^^^^^^ j. (34) 

It is enough to prove this for functions F(ai , . . . , a^) = a"' ■ ■ ■ a^*^ for integer powers ni,.. .,nj^>0, 
and this immediately follows from (|33T ) by considering / on q{ni + . . . + ni^) replicas given by the 
product of copies of /i , . . . , /^t on different replicas, so that each fj appears n,- times in this product. 

3 Pure state 

In this section, we will show that in the region © the function a(w, w, v) in (fT6l) corresponding to 
any ji G ^inv essentially does not depend on the coordinate u. In other words, for almost all w, the 
Gibbs measure G^ in (fT9l ) is concentrated on one function in L^([0, l],(iv) n{||d'||oo< 1}. This is 
expressed by saying that the system is in a pure state. 
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Theorem 5 Under ©, o{w,u,v) = E„0'(w, m,v) for almost all w,u,v G [0, 1], where E„ denotes 
the expectation in u only. 

When the system is in a pure state, we will simply omit the coordinate u and write o{w,v). In this 
case, a joint moment of finitely many spins, 

does not depend on replica indices, which means that we can freely change them, for example, 
E5}5j525'2 = E5}5j52i'2- As in [ilOJ . the strategy of the proof will be to show that we can change one 
replica index at a time, 

where a finite set of indices C does not contain (1,1) and (1,^')- Using this repeatedly, we can 
make all replica indices different from each other, showing that any joint moment depends only on 
how many times each spin index i appears in the product. Of course, this implies that 

Ells^i=EllE,o{w,u,Vi), 

i,i i,£ 

so we could replace the function a(w, m, v) by EuO{w, m, v) without changing the distribution of the 
array (^f ) . This would be sufficient for our purposes, since we do not really care how the function 
a looks like as long as it generates the array of spins (^f) with the same distribution. However, it 
is not difficult to show that, in this case, the function d{w,u,v) essentially does not depend on u 
anyway. Let us explain this first. 

Proof of Theorem^(assuming ^35\)}. If (|35l) holds then Ej'|5j5252 = E5}5^52i'2- This can also be 
written in terms of the asymptotic overlaps Rgf defined in (fTSi) as 

ERl2 = ERi,2R3A- 

Since Rg^i/ is the scalar product in (L^ [0, 1] , dv) of replicas o^ and o^ drawn from the asymptotic 
Gibbs measure Gw in (fT9l ), 

= Ei?2 2 - ERi^RsA = EVarG„(cyi • cr^), 

which implies that for almost all w the overlap is constant almost surely. Obviously, this can happen 
only if Gw is concentrated on one function (that may depend on w) and this finishes the proof. D 



In the rest of the section we will prove (1351) . The main idea of the proof will be almost identical 
to Section 6.2 in [[TOll . even though there will be no induction on the system size. One novelty 
will be that the cavity equations (l25l) for the asymptotic Gibbs measures will allow us to give a 
different argument for large values of /3, improving the dependence of the pure state region on the 
parameters. We will begin with this case, since it is slightly simpler. 

Without loss of generality, we can assume that £' = 2 in (|35] ). Given m,q> 1, for j = 1,2, let 
us consider functions fj{0i,02) on { — 1, 1}'"^? with 0\ and 02 as in (|28l) . We will suppose that 

0</2and |/i|</2. (36) 



Let us fix n < m and, as before, we will treat the first n coordinates as cavity coordinates. Consider 
the map 

r:{-l, + l}"'^«^{-l, + l}'"^^ (37) 

that switches the coordinates (a/,...,a,J) with {af,...,o^) and leaves other coordinates un- 
touched. The statement of the following lemma does not involve j8, but it will be used when /3 
is large enough. 



Lemma llf{p— l)pa < 1 and the function /i satisfies f\oT — —fi then 

E7i(*i,*2) 



E 



0. 



(38) 



To see that ^ implies ([35]) with f = 2, take n = 1, /a = 1 and /i = 0.5(c7/ - erf) Y{[ii)^c<^i- 

Proof. By (l36l) . the function /2 on { — 1, 1|™^^ is strictly separated from 0, so we can use (|34] ) with 
k = 2 andF(ai,a2) = <^\/ci2 to get 



E 



E7i(5i,52) ^ E'Av/i(£,52)^(e) 



E72(*l,*2) 



E 



E'Av/2(e,52)^(e) 



(39) 



Recall that Av is the average over e = {£-)i<n/<q ^ {— 1, 1}"^^ and 



<f(e) = nexp£A,-,(e/), whereA,-,(e/)= £ 0,, (4,, „...,4_i, ■„£/)■ (40) 

(.<q i<n k<7ti{ap) 



For a moment, let us fix all the random variables 7ti{ap) and Of^t and let r := ^,<„ 7ti{ap) . Observe 
right away that if r = then £'{£) = 1 and 



Av/i(e,^2)^(e)=Av/i(e,52)=0. 

This is because the average Av does not change if we switch the coordinates (Cj', 
(e^, . . . , £,^) (in other words, just rename the coordinates) and, by assumption, 

Av/i(e,^2)=Av(/i(e,^2)or) = -Av/i(e,^2). 

Now, let us denote the set of all triples ( j, ?, k) that appear as subscripts in (|40] ) by 

J= [UJ^k] : j < p - IJ < n,k < Ki{ap)} . 






(41) 
^^ with 



(42) 



If we denote by si = {sl)eeJJ<q ^U the coordinates of the array s that appear in S'{£) then, for 
r > 1, we can think of the averages on the right hand side of (|39] ) as functions of S2 and si, 

fj = fj{h,S2) :=Av/;-(e,52)^(e). (43) 

Even though S2 and si are random variables, for simplicity of notation, here we think of them also 
as variables of the functions //. First of all, since |/i | < fi. 



l/il < Av|/i(e,52)K(e) < Av/2(£,52)^(e) = I/2I. 



Similarly to T , let f now be the map that switches the vectors of spins {s\)eej and {sl)eeJ i^i h 
corresponding to the first and second replica. Let us show that f\ot = —f\ . First, we write 

/lof = Av(/i(e,52)(^(e)of)). 

As above, we will use that the average Av does not change if we switch the coordinates (£/,...,£,!) 
with(ej2,...,e2),so 

/lof = Av((/i(e,^2)or)(<f(£)ofr)). 

By assumption, /i o T = — /i and it remains to notice that <#'(e) o TT = (^(e), because TT simply 
switches all the terms A, i and A, 2 in the definition oi S{e). We showed that (l39l) can be rewritten 
as 



E 



E7l(^l,^2) _^E7i(5i,52) 



E72(*l,*2) 



E'/2(^~l,^2) 



(44) 



and, conditionally on TZi{ap) and Oij^, the pair of functions /i,/2 satisfies the same properties as 
/i , /2. The only difference is that now n is replaced by the cardinality of the set J in (|42|) . equal to 
{p — l)r. For a fixed n, let us denote by D{n) the supremum of the left hand side of (1391 ) over m>n 
and all choices of functions /i,/2 with the required properties. Then, the equation (|44T i implies 
(first, integrating the right hand side conditionally on all Ki{ap) and dik) 

D{n) < ED{{p - l)r) = ED{{p - l)7r{nap)), (45) 

where Tz{nap) := r = Y.i<n'^i{^P) i^ ^ Poisson random variables with the mean nap. Recall that, 
by (|4TI) . /i = when r = 0, so we can set D(0) = 0. Also, the assumption |/i | < /2 gives that 
D{n) < 1 and, thus, D{n) < n. Then, (l45l) implies 

£)(n) < E(;? - l);r(nap) = (p- \)pan. 

Using (l45l) repeatedly, we get, by induction on 7 > 1, that D{n) < {{p — \)payn. By assumption, 
[p — \)pa < 1, so letting j ^ °° proves that D{n) = for all n. This finishes the proof. D 

For small values of /3, we will give a slightly different argument, following Section 6.2 in [fTOl . 

Lemma 2 /n ?/ze notation of LemmaUl suppose that n = \ and 

{p-l)pal5exp{2l5 + ap{e^l^-l)) < 1. (46) 

If fi°T = -/i then (ES]) i'ri/Z /zoW*. 



Proof. The first part of the proof proceeds exactly the same way as in Lemma [B and we obtain 
(|44l) for the functions f\ , /2 defined in (|43l) . Since n = 1 , we can rewrite (|40] ) as 



<^(e) = nexpA^(ef), where A£= £ 0^(4^,...,4_i^^,£f), (47) 

and the set (|42|) now becomes 

/={(j,^) : J<p-l,'t<^i(ap)}. (48) 
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Its cardinality if (p — 1 ) r, where r = ;ri ( ap) . Even though we showed that fiof — —f\ , we can not 
draw any conclusions yet since the map T switches only one spins in the first and second replicas, 
while T switches {p — \)r spins {sl)eeJ and {s^)eeJ in ■^u of course, conditionally on ;ri(ap) and 
Ok- We will decompose /i into the sum /i = Leey/e? where each fe satisfies feofe = —fe with 
some map fg that switches si and s^ only. We begin by writing 



/i=^(/i-/i°3')=^(/i-/i°n^'^)- 

If we order the set J by some linear order < then we can expand this into a telescopic sum, 

f^=i:\{f^-nTe'-fioUfe'] 

Then we simply define 

L: = 

2 



e'<e 



e'<e 



fe-=\{flo\[f,-ho\[f,, 



e' <e e'<e 

and notice that fe°te = —fe, since fefg is the identity. Equation ((44l) implies 



E 



E7l(^l,52) 



E72(^l,^2) 



<e£ 



E7.(^~1,^2) 



E72(^~l,*2) 



(49) 



We keep the sum inside the expectation because the set J is random. Recalling the definition of /,■ 
in (l43l) . we can write (for simplicity of notation, we will write (S instead of i^(e) from now on) 



fe{suS2)=^-Av{fi{e,S2)[SoY[f,,-SoY[T, 

e'<e e'<e 



All the maps t^ switch coordinates only in the first and second replica. This means that if we write 
tf defined in (E) as c? = S'<g" where 

^' = exp(Ai+A2), (?"= n ^^P^^ 

3</<9 



then 



fe{suS2) = iAv(/i(e,52)^"(^'o n f,~S'oY[ f,,)). 

e'<e e'<e 



(50) 



If e = (j, k) then the terms in the last difference only differ in the term ^(■^i yt' • • • ' ■^l-i yf ^f ) • Since 
% ^ [~/^9 (^] and Ai +A2 < 0, we can use that \e^ — e^\ < \x — y\ for x, j < to get that 



e'<e 



e'<e 



Therefore, from (pOl ) we obtain 

|/.(^~i,^2)| </3Av(|/i(e,52)K'0 <i8Av(/2(e,52)^")- 
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Similarly, using that Ai +A2 G [-2/3;ri(ajc»),0] we get that 

/2(^~i,^2) = Av(/2(e,52)^) = Av(/2(e,52)^'^") >exp(-2/3;ri(ap))Av(/2(e,52)^")' 
and together the last two inequalities yield 

|/.(^~i,^2)| < /3exp(2/3;ri(ap))/2(*~i,^2). (51) 



Let D be the supremum of the left hand side of (1491 ) over all pairs of functions /i , /2 such that 
l/il < /2 and f\oT = — /i under switching one coordinate in the first and second replicas. Then 
conditionally on 'it\{ap) and the randomness of all Ok, each pair /g, /2 of the right hand side of (1491 ) 
satisfies (ISTI) . and we showed above that /^ o Tg = — /^ under switching one coordinate in the first 
and second replicas. Therefore, (|49T l implies that 



D<DE£/3exp(2/3;ri(ap))=D/3(p-l)E:7ri(ap)exp(2j8;ri(a/7)). (52) 

Even though, formally, this computation was carried out in the case when TZ\{ap) > 1, it is still 
valid when 7ri{ap) = because of (I4TI) . Finally, since ;ri(ap) has the Poisson distribution with 
the mean ap. 



E;ri(a/7)exp(2/3;ri(a;?)) = £ /te^/^^i^g-^P = apcxp{2p + ap{e^^ - 1)) 



A:>0 



The condition (|46l) together with (|52l ). obviously, implies that D = and this finishes the proof. D 

To finish the proof of Theorem |5l it remains to show that the region ^ is in the union of the two 
regions in the preceding lemmas. 

Lemma 2>If© holds then either p{p — l)a < 1 or (|?^ holds. 

Proof. If /3 > 1/4 then p{p-l)a < 1. Now, suppose that /3 < 1/4 and /?(/?- 1) a/3 < 1/4. First 
of all, we can bound the left hand side of (|46l ) by 

{p-\)pal5exp{2l5 + ap{e^l^ -\)) < -exp{2l5 + ap{e^P -I)). 
Using that e-^P — 1 < v^2/3 for /3 < 1/4 and pa/3 < 1/4, we can bound the right hand side by 

-exp(- + 2v/^pa/3) < -exp(- + -V^) ^0.94< 1, 
and this finishes the proof. □ 

4 Inside the pure state 

Suppose now that the system is in a pure state and, for each /i G ^inv, the corresponding function 
o{w, u,v) does not depend on the second coordinate, in which case we will write it as 6{w,v). Let 
us begin by proving Theorem \T\ 
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Proof of Theorem [TJ When the system is in a pure state, we can rewrite the functional <^(/i) in 
(|26|) as follows. First of all, since the expectation E' is now only in the random variables x, which 
are independent for all spin and replica indices, we can write 

E'exp0(5i,...,5p) = l + (e-^-l) n ^^i^ = exp0(ai,...,ap), 

l<i<p ^ 

where a,- = E'^/ = E'a(w,M,v,-,Jc,-) = E'a(w,M,v,-) = a(w,v,-). Similarly, 

E'Avexp Y^ 0;t(*i,yt,---,*p-i,yt,e)=Avexp J^ 0^(ai,^,.. .,d-p_i,^,e), 
k<K{pa) k<7t{pa) 

where d,-,t = 0'(w, v,jt)- Therefore, the functional ^{}l) in (|26|) can be written as 

,^(M)=log2 + ElogAvexp £ 0^(ai,fe,...,ap_i,^,e) 

fe<:;r(pa) 

-(p-l)aE0(ai,...,ap). (53) 

Replacing the average over w G [0, 1] by the infimum, this is obviously bigger than 

inf EJlog2 + logAvexp Y 0^(e,ai,^, .. .,ap_i.fc) - (/?- I)a0(ai,. ..,ap)), 

^^[O'll ^ k<K{pa) ^ ^ 

where Ev is the expectation only in the random variables (v,) and (v,-^^). For a fixed w, the random 
variables Oi and Oj^k are i.i.d. and, comparing with (|5]), this infimum is bigger than inf^£P).[_i i] =^(C)- 
Since this lower bound holds for all ji G ^inv. Theorem |4] then implies that 

limF^> inf ^(C). 

The upper bound follow from the Franz-Leone theorem [3] by considering functions o{w, w, v) that 
depend only on the coordinate v (see Section 2.3 in [7|, and also [|6l[T0l). As we mentioned above, 
it was observed in Theorem 6.5. 1 in [[TOl that the upper bound holds for all p >2. D 



Let us also write down one consequence of the cavity equations (1251) for a system in a pure state. 
Again, let d; = d(w, v,) and denote Oj^i^^ = 0'(w,Vj^,-^,t)- Let 

, ^ Av£expA,(£) 

' AvexpA,-(e) ' ^ ^ 

where 

Ai{£)= £ 0yt,/(^i,,>,---,o-p_i,,-^,e). (55) 

k<7ti{ap) 

We will now show that the cavity equations (l25l) imply the following. 



Lemma 4 If the system is in a pure state, for example in the region ®, then 



(^0,>i = (^/),>i- (56) 
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Proof. This can be seen as follows. Take r = and n = mm (|25l) . so all coordinates will be viewed 
as cavity coordinates. Since the expectation E' is now only in the random variables x, which are 
independent for all spin and replica indices, as in the proof of Theorem [T] we can write (slightly 
abusing notation) 

[/f = Av ]^ e,-exp Y^Ai{£i) and V = Avexp ^A/(e/), 

/eC/ i<n i<n 

where A,(e) are now given by (|55T ) instead of (|23l) . i.e. after averaging the random variables x. 
Therefore, Ui/V = H/eQ ^/- Since E'll/eQ ^i = HieCi ^'' <|25l) becomes 

e<qieCi e<qieCi: 

By choosing q and the sets Q so that each index i appears nj times gives EHk/j ^f' = EIlKn ^i "' 
and this finishes the proof. D 

5 Proof of Theorem 111 

In this section we will prove Theorem [2] and we begin with the following key estimate. For a 
moment, we fix the randomness of (%) and think of Tr defined in ([91) as a nonrandom function. 

Lemma 5 The function T^ defined in (19]) satisfies 

m<yj,k))-Tr{{o'j^,))\<\ieP-l)l^\Oj,,-o'j^,\. (57) 

Proof. Let us compute the derivative of T^ with respect to aij . If denote the derivative of 

e,K„...,a,_,,,.£)=iog(i+(^-''-i)i^ n ^^4^ 

^ 1<;<P-1 ^ 

with respect to Cij by 

0i=exp(-0i)(e ''-l)-^ -^^ II ^-^^ 

2<j<p-l ^ 

then 

dTr Ave0|expA(£) Av£expA(£) Av0|expA(e) 



da\^\ AvexpA(e) AvexpA(e) AvexpA(e) 

Since 01 G [-/3,0], we see that 71,1 Oj' e [(l-e^)/2,0] and 



Av0i'expA(e) 
^1 - 



AvexpA(e) 



<\i/-r. 



which implies that \dTrld<3\^\\ < {e^ — l)/2. The same, obviously, holds for all partial derivatives 
and this finishes the proof. D 
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Step 1. Let us first show that, under (|8]), there exists unique fixed point T{Q = C,. The claim will 
follow from the Banach fixed point theorem once we show that the map T is a contraction with 
respect to the Wasserstein metric V7(P, Q) on Pr[— 1,1]. This metric is defined by 

W{¥,q)=mm\z^-z\ (58) 

where the infimum is taken over all pairs (z\z^) with the distribution in the family M(P, Q) of 
measures on [—1,1]^ with marginals P and Q. It is well known that this infimum is achieved 
on some measure /i G M(P, Q). Let (z);t'^/yt) ^^ ^•^•^- copies for j < p — 1 and ^ > 1 with the 
distribution ji. By (l57l) and Wald's identity, 

^T^iap){{z],k))~T,f^ap){{zl,))\ < \{e^-m £ l^-^^l 

j<p-\,k<Tt(ap) 

= \{e^ - \){p~\)panzi, -ziil = ^-{e^ - \){p-\)paW{¥M- 

On the other hand, by the definition (fT2] ). the pair of random variables on the left hand side, 

has the distribution in M(r(P), r(Q)) and, therefore, 

W(r(P),r(Q))<i(/-l)(p-l)paW(P,Q). 

The condition ([8]) implies that the map T is a contraction with respect to W. Since the space 
(Pr[— 1, 1], V7) is complete, this proves that T has a unique fixed point C,. 

Step 2. Now, suppose that both @ and ([8]) hold. Let C, be the unique fixed point r(^) = C, and 
let 0'(w, V, u) be the function corresponding to a measure /i G ^mv in the statement of Theorem |4] 
By Theorem m we know that o does not depend on u and, therefore, d(w,v) satisfies Lemma HI 
Recall that Oi = d{w,Vi) and let (z/)/>i be i.i.d. random variables with the distribution ^. We will 
now show that 

N,>i = (^0,>P (59) 

which together with (|53l) will imply that ^(/i) = ^(^) for all ^u G ^mv, finishing the proof. (By 
the way, the fact that (a,),>i are i.i.d. does not mean that the function d{wj u) does not depend on w; 
it simply means that the distribution of (d'/)/>i is independent of w.) To show (l59l) . we will again 
utilize the Wasserstein metric. For any n > 1, we will denote by D{n) the Wasserstein distance 
between the distribution of {Oi)i<„ and the distribution of (z,)k„ (equal to ^®") with respect to 
the metric d{x,y) = £,<„ \xi — yi\ on [—1, 1]". For any r = (ri, . . . , r„) G W (we assume now that 
G N), let us denote 

Pr = ^{%x[ap) = n,...,%n{ap) = rn)=\}^^^e-^P. 

i<n ^i ■ 

Since ^ = r(^), recalling the definition of r(^) in (fT2l) . we get 

^^n ^ j^^^^n ^ £ p^ (S}'^(Tn{izj,k)j<p-i,k<n)), (60) 
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where the random variables Zi,k are i.i.d. and have distribution ^. Next, similarly to (|9]), let us define 

T (r. r. \ Av£expA,-(£) 

where 

A,-(e) = £ 0yt,/((yi,yt, • • • , o-p-ii, £)• 

In other words, 7^>,. is defined exactly as Tr., only in terms of independent copies (Okj) of {Ot}- 
Then, Lemma |4] and (|54l) imply that 

(^Ok.= I i^.^((7^-,.((^M^);<p-i,^<n)).< )■ (62) 

Using the fact that Ti^n are copies of T^, defined independently over i, we can rewrite (|60] ) by 
expressing the product measure as a distribution of a vector with independent coordinates, 

C^'^= £ /..i^((7;-,,((z,,,,),<,_i,,<,,)) ), (63) 

where the random variables Zj,i,k are i.i.d. with the distribution ^. For a given r G N", let us denote 
by ¥r and Q^ the laws on the right hand side of (|62|) and (|63T ). Since the Wasserstein metric satisfies 
an obvious inequality for convex combinations of measures 

W( £ Pr^r: £ PrQr) < £ P.W^ (P„ Qr) , (64) 

it remains to estimate the distance between P^ and Q,-. By Lemma[5l 

n 1 n n p— 1 

L '^i,n{i^j,i,k)j<p-i,k<n)-Ti,ri{{zj,i,k)j<p-l,k<n) < iz{e^ " 1) L L L \^j,i,k-Zj,i,k\- 



i=\ 



i=ik^\j=\ 



Choosing the vectors i&j,i,k) and (zj^i^k) on the right hand side with the optimal joint distribution 
that achieves the infimum in the definition of Wasserstein distance and taking expectations proves 
that 

W(P„Q,.)<^(e'^-l)Z)((p-l)£r,). 

i<n 

Plugging this into (|64l) and using (|62l ) and (|63l) proves that 

D{n)<l{eP-l) l^ PrD({p-l)l^r,) =UeP -mD{{p-l)K{apn)), (65) 

where K{apn) is a Poisson random variable with the mean apn. We start with an obvious bound 
D{n) < In. Then, by induction on j, (|65] ) implies that 

D(n)<2(i(e/^-l)(;?-l);?a)'n 

for all J > 1 . Letting j ^ °° proves that D{n) = for all n, since we assumed ([8]), and this finishes 
the proof. D 
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